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Abstract 

This article provides entropic inequalities for binomial-Poisson distributions, derived 
from the two point space. They appear as local inequalities of the M/M/cxd queue. They 
describe in particular the exponential dissipation of "l>-entropies along this process. This 
simple queueing process appears as a model of "constant curvature", and plays for the 
simple Poisson process the role played by the Ornstein-Uhlenbeck process for Brownian 
Motion. Some of the inequalities are recovered by semi-group interpolation. Additionally, 
we explore the behaviour of these entropic inequalities under a particular scaling, which sees 
the Ornstein-Uhlenbeck process as a fluid limit of M/M/cx) queues. Proofs are elementary 
and rely essentially on the development of a ""l>-calculus" . 

MSG 2000. 47D07; 60J60; 94A17; 26D15; 46E99; 60J27; 60J75. Keywords. Functional 
Inequalities; Markov processes; Entropy; Birth and death Processes; Queues. 

1 Introduction 

We consider in this article the M/M/oo queueing process. This elementary continuous time 
Markov process on N plays for the simple Poisson process the role played by the Ornstein- 
Uhlenbeck process for Brownian motion. In particular, its law at time t is explicitly given 
by a binomial-Poisson Mehler like formula, and the associated semi-group commutes with the 
discrete gradient operator, up to a time decreasing exponential factor. We derive general entropic 
inequalities for binomial-Poisson measures from the two points space, essentially by convexity. 
They hold in particular for the law at fixed time of the process, as for Ornstein-Uhlenbeck. In 
particular, these entropic inequalities contain as special cases Poincare inequalities and various 
modified logarithmic Sobolev inequalities, which appear for instance in 0, \W\ and [Sl- 
it is known that the lack of a chain rule and of a good notion of curvature in discrete space 
settings make difficult the derivation of entropic inequalities for discrete space Markov processes. 
Poincare inequalities are exceptional, due to their Hilbertian nature. Their derivation does 
not need the diffusion property. Levy processes and Poisson space are also exceptional, since 
their i.i.d. underlying structure makes them "flat" in a way. This nature is translated on the 
infinitesimal Markov generator as a commutation with translations. The M/M/oo queue has 
non-homogeneous independent increments, and is thus beyond this framework. The reader may 
find various entropic inequalities for finite space Markov processes in ^| and |2] , and for 
infinite countable space Markov processes in [50 ] . [T]. P ^ . P ^ . P1I5]. [TT ] . PHT^ITC] . 
PT] for instance. 

Birth and death processes are the discrete space analogue of diffusion processes. However, 
they are not diffusions, and specific diffusion tools like Bakry-Emery I2 calculus are of difficult 
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usage for such processes. It follows from our study that the M/M/cx) queueing process can serve 
as a model of "constant curvature" on N. It is known that convexity may serve as an alternative 
to the diffusion property, as presented for instance in [22] and ^Tj. In this article, we circumvent 
the lack of chain rule by elementary convexity bounds for germs of discrete Dirichlet forms. This 
work can be seen as a continuation of pTj , and was initially motivated by the time inhomogeneous 
M/M/cxD queue which appears in the biological problem studied in The notion of queueing 
process is widely used in applied probability. The reader may find a modern introduction to 
queueing processes in the book .''> I by Robert, in connection with random networks, general 
Markov processes, martingales, and point processes. This large family of Markov processes 
contains, as particular cases, the simple Poisson process, the continuous time simple random 
walk on N, and more generally all continuous time birth and death processes on N. 

The approach and results of this article may be extended by various ways. The first step is 
to consider birth and death processes on N or Z, and then on or 1!^ with interactions. Some 
versions of such models where already considered in the statistical mechanics literature, at least 
for Poincare and modified logarithmic Sobolev inequalities, see for instance ^lE] ^^Eli 
and references therein. These extensions concern continuous time processes on a discrete space 
E with generator of the form 



where 7^ is the "jump measure" at point a;, which is a finite Borel measure on E. Another possi- 
bility is to consider Volterra processes driven by a simple Poisson process, possibly together with 
Clark-Ocone formulas as in '2' and for instance. We hope that some of these extensions will 
make the matter of forthcoming articles. We have in mind the construction of a functional bridge 
between discrete space Markov processes and "curved" diffusion processes, which complements, 
by mean of quantitative functional inequalities, the approximation in law. The recent articles 
[ini. El, [ElE], UmiSllTni, EOI, and EI] may help for such a program. 

The entropic inequalities that we consider in this article can be called "<I>-Sobolev inequalities" 
since they involve a ^-entropy and a $-Dirichlet form. They contain in particular Poincare 
inequalities and "L"'^"-logarithmic-Sobolev inequalities. As presented in ,11 , they hold, under 
convexity assumptions on <I>, for log-concave measures on R'^, for diffusions on manifolds with 
positive bounded below curvature, for many Wiener measures, for Poisson space, and for many 
Levy processes. Their genericity on $ is particularly interesting in discrete space settings for 
which no chain rule is available. The aim of this article is to extend these entropic inequalities to 
discrete space processes, beyond the i.i.d. increments case, in particular, beyond Levy processes 
and Poisson space. 

This work goes beyond many results of [S], in terms of entropies, Dirichlet forms, and mea- 
sures. We show how the entropic inequalities are scaled when the discrete space curved process 
(M/M/cx)) approximates a curved diffusion process (Ornstein-Uhlenbeck). This work can thus 
be seen as a precise and instructive case study. Many aspects are still valid for more general 
birth and death processes, and we believe that the entropic inequalities that we consider here 
hold for interacting birth and death processes. However, a lot of work is still needed to achieve 
this objective. In particular, and to our knowledge, a good notion of curvature is still lacking 
for interacting birth and death processes. Viewed as a unidimensional (e.g. single site) particle 
system, the M/M/00 queue is not conservative. In particular, it cannot be viewed as a partic- 
ular unidimensional case of the interacting birth and death processes considered in [IHI 1141 ITK] . 
However, it belongs to the models considered in '16'. 

Outline of the rest of the article. In the introduction, the definition of the M/M/00 queue- 
ing process is followed by the presentation of links and analogies with the Ornstein-Uhlenbeck 
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process, and then by the introduction of the ^-entropy together with the A— B — C transforms of 
Section two is a two point space approach to binomial-Poisson entropic inequahties. In Sec- 
tion three, we address the exponential decay of $-entropy functional along the M/M/oo queue, 
we give various proofs of entropic inequalities by using semi-group interpolations, and we use 
a scaling limit to recover Gaussian inequalities for the Ornstein-Uhlenbeck process. The fourth 
and last section is devoted to key convexity properties related to the A — B — C transforms. 

1.1 The M/M/oo queueing process 

The M/M/oo queue with input rate A ^ and service rate > is a particular space- 
inhomogeneous and time-homogeneous birth and death process on N. Let Xt be the number 
of customers in the queue - i.e. the length of the queue - at time t. The name "M/M/oo" comes 
from Kendall's classification of simple queueing processes. It corresponds to an infinite number 
of servers with random memoryless inter-arrivals (first M) and service times (second M), see for 
instance |31l p. xiii]. Since the number of servers is infinite, each client gets immediately his 
own dedicated server, and the length of the queue is exactly the number of busy servers. The 
infinitesimal Markov generator L of the M/M/oo queue {Xt)t^o is given for any / : N — > M and 
any n S N by 

L(/)(n)=nMD*(/)(n) + AD(/)(n), (1) 
where the discrete gradients D and D* are defined respectively for any / : Z ^ M and any n G N 

by 

D(/)(n) :=/(n + l)-/(n) and D*(/)(n) := /(n - 1) - /(n). (2) 

The operators D and D* commute with translations, but L does not. Notice that /(—I) does 
not need to be defined in ^ since it is multiplied by 0. The stared notation for D* comes from 
the fact that D* is the adjoint of D with respect to the counting measure on Z. The identity 
DD* = D*D = — (D + D*) leads to a polarised version of the infinitesimal generator Q), 

L(/)(n) = -A(DD*)(/)(n) + {n^x - X)D*{,f){n), 

for any n e N and / : N ^ M. The finite difference operator DD* is the discrete Laplacian, given 
by (DD*)(/)(n) = 2/(n) - f{n - 1) - f{n + 1) for any / : Z ^ M and any n e Z. Consider the 
process conditional to the event {X^ = n\. Let T :— min{i > s : Xt Xg} — s be the waiting 
time before next jump. Then T follows an exponential law £{X + nfj.) of mean 1/(A -I- nfi). The 
transition matrix J of the embedded discrete time jump Markov chain is given for any m, n G N 

by 

{nfi if TO = n — 1 
A if TO = n + 1 , 
otherwise 

where we assumed for simplicity that A + /i > 0. The embedded chain is recurrent irreducible as 
soon as A > and /x > 0. The jump intensity function n i— > A -|- n/i is not bounded when /i > 0, 
however, the process is not explosive by virtue of Renter criterion for irreducible birth and death 
processes, cf. Theorem 4.5]. 

Defining a stochastic process corresponds to specify a law on paths space. Following |^ 
Chap. 6], the stochastic process {Xt)t^o with Xq — n can be constructed as follows : 

CO „ 

Xt = n+Afx{]0,t])-y2 l{x.>^}AA;(ds), 
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where Af\ is a Poisson random measure on R_|- of intensity A and where (A/'^)igN is an i.i.d. 
collection of Poisson random measures on M_|_ of intensity yit, independent of A/a. In other words, 
the process (Xt)t^o solves the Stochastic Differential Equation 



dXt=Nx{dt)^y mdt) 
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Let us consider the filtration {Tt)t^o defined for any t E by 

J't ■.= <y{JVx{]0,s]);se [0, i]} V a{AA;(]0, s]); (s, e [0,t] xN}. 

The process {Xt— Xq— Xt+ ^ Iq-^s ds)t^o is a square integrable martingale with increasing process 

given hy Xt + n JqXs ds. More generally, the process (^t)t^o is a solution of the martingale 
problem associated to the Markov generator L defined by (^). Namely, for any / : N ^ K, the 
process 

f{Xt)^f{Xo)- I Uf){Xs)ds 



is a local martingale. When f{n) — n for any n G N, we get 'L{f){n) = A — fin. The Markov 
semi-group (Pt)f^o of (Xt)t^o is defined for any bounded / : N — > R by 

in) E(/(XO |Xo - n) , 

in such a way that Pf(lA) (n) = F{Xt € A\Xo ^ n) for any A C N. Wc have Pt(-) (n) = 
£{Xt \Xo = n) for any n g N. In particular. Ft o = Pt+s, and Pq — Id, and L/ :— 9f=oR(/)- 
The coefficient p of the M/M/oo queue is defined by 

A 

P — -• 

M 

In the sequel, we denote by Eq(/) or by Eq/ the mean of function / with respect to the 
probability measure Q, and by U'{Q) the Lebesgue space of measurable real valued functions / 
such that \ff is Q-integrable. For a Borel measure on N, we also denote Q{'n) := Q{{n}) for 
any n € N. 

1.2 The Ornstein-Uhlenbeck process as a fluid limit of M/M/oo queues 

The Ornstein-Uhlenbeck process can be recovered from the M/M/cxd queue as a fiuid limit, by 
using a Kelly scahng. See for instance OEH] and the books [S], ^H], and Namely, for any 
iV € N, let {X^)t^o be the M/M/oo queue with input rate iVA and service rate /i > 0. Define 
the process {Y/^)t^o by 

t t 

For any x £ M+, let m : K+ ^ M be defined by m(t) := p + (x — p)p{t) for any t e M+, where 
:— e^^*. Consider a sequence of initial states (X,5^)jvgN such that 

hm 1/ = hm —X^^x. 

Then, for any t e 1R.+ , the sequence of random variables (supg^gj^t — m{s)\) ^^^^ converges 
in towards when TV ^ oo, see for instance |^ Section 6.5]. In particular, for any e > 0, 

lim P( sup IFj^ - m(s)| > e ) = 0. 
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Moreover, this Law of Large Numbers is complemented by a Central Limit Theorem, see for 
instance |7j and Namely, define the process {Z^)t^o by 



N 

Notice that m{0) — x. Let y G M and assume that the initial states (X,^)ArgN satisfy additionally 
that 

hm = lim ^{Y^ ~x) ^y. 



A basic example is given by Xq — \Nx + \fNy\ where [-J denotes the integer part. Then, 
the sequence of processes {Z^)t^Q converges in distribution, when N — > oo, towards a process 
denoted (Z^)t^Q, with non-homogeneous independent increments, given by 



Z^ yp{t) + p{t- s)y/\ + x^i dB, 



where (i?s)s^o is a standard Brownian Motion on the real line. In particular, when x = p, then 
m{s) — p for any s S R+, and {Z^)t^o is in that case an Ornstein-Uhlenbeck process, solution 
of the Stochastic Differential Equation Z^ = y and dZ^ = \/2\dBt — iiZ^dt, where (-64)4^0 is 
a standard Brownian motion on the real line. Additionally, for any t G M+, 

c{zr I ^0" = y) = Sypit) * AA(o, (1 

where J\f{a, b) denotes the standard Gaussian law on K of mean a and variance b. This Mehler 
formula is the continuous space analogue of JSJ. The Markov infinitesimal generator of {Z^)t^Q 
is the linear differential operator which maps function y ^—^ f(jj) to function 

y ^ ^f"{y) - f^yf'iy)- 

The symmetric invariant measure of {Z^)t^Q is the Gaussian law Af(0,p). The fi parameter 
appears clearly here as a curvature, whereas the A parameter appears as a diffusive coefficient. 



1.3 The M/M/00 queue as a discrete Ornstein-Uhlenbeck process 

Let {Xt)t^o be an M/M/cx3 with rates A and p. When p vanishes, (A^t)t^o reduces to a simple 
Poisson process of intensity A, and admits the counting measure on N as a symmetric measure. 
A contrario, when A vanishes, {Xt)t^o is a pure death process, and admits So as an invariant 
probability measure. 

The M/M/00 queue plays for the simple Poisson process the role played by the Ornstein- 
Uhlenbeck process for standard Brownian Motion. The law of the M/M/00 queue {Xt)t^o is 
explicitly given for any n G N by the following Mehler like formula 

CiXt\Xo = n)= B{n,p{t)) * V{pq[t)), (3) 

where 

pit) e"''* and q{t) := 1 - p{t). 

When p = 0, we set pq{t) — A, since A = lim^^o+ Plit). Here and in the sequel, B{n,p) stands 
for the binomial distribution B{n,p) :— {p6i + qSo)*" of size n G N and parameter p G [0, 1], 
with the convention B{n,0) := Sq and B(n, 1) :— 5„. The notation 7'(cr) stands for the Poisson 
measure on N of intensity a > 0, defined by Via) e-" J2T=o V.'^^^k- When p>0, the process 
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{Xt)t^o is ergodic and admits P{p) as a reversible invariant measure. In other words, for any 
n e N and s G R+, 

lim C{Xt\Xs = n)^Vip). 

n — *oo 

Moreover, Ep(p)(Pf/) = 'Ei-p(^p){J) for any / e \}{V{p)) and any t £ M.^, or equivalently 
E-p(-p')(L/) = for any / e L^(7^(/9)). As for the Ornstein-Uhlenbeck process, this convergence 
is not uniform in n since for any a > 0, 

hm C{X -1 iog(„/a) \Xs=n) ^ Via + p). 

The mean and variance of C{Xt\Xs ~ n) with t ^ s ^ are given respectively by 

np{t — s) + pq{t — s) and {np{t — s) + — s). 

The semi-group (Pt)t^o of the M/M/oo queue shares the nice "constant curvature" property 
with the Ornstein-Uhlenbeck semi-group. Namely, for any t € M4., any n S N, and any bounded 

/ : N^M, 

DPJ = e-^'*PtD/. (4) 

The infinitesimal version writes [L, D] := LD — DL = /iD. The commutation can be deduced 
simply from (O. Namely, if Xi, . . . , Xn+i^Y are independent random variables with Xi ^ 
B{l,p{t)) andY ^V{pq{t)), 

Pt(/) (n + 1) = E(/(Xi + • • • + X„+i + Y)) 

= E(E(/(Xi + • • • + X„+i + r)|x„+i)) 

= pWPt(/(i + -))N + '?WR(/) H 

= p(t)R(D/) (n)+R(/)(n). 

This fact and the properties of the A — B — C transforms introduced in the sequel give rise to 
various entropic inequalities, by using the semi-group (Pt)t;^o as an interpolation flow. 

We give now various binomial-Poisson "integration by parts" formulas. Let _ff„_p(m) :— 
(m)^''"'?" ™ ^^"^ ^'^y P ^ ^"^^ integers n and m with ^ to ^ n. We have then 

'fnHn^p{m) — npHn~i,p{m — 1) as soon as < to ^ n. As a consequence, for any function 
/ : N ^ M , any n eN* and any p e [0, 1] 

(/(! + •)), (5) 

where ft, : N — > M is defined by h{k) — k for any fc G N. Similarly, {n — m)Hn,p{m) = nqHn-i,p{m) 
as soon as ^ to < rt, which gives for any function / : N ^ M , any n e N* and any p E [0, 1] 

^B(n,p){{n - ft)/) = ngEg(„_i^p)(/) . (6) 

For p > 0, the binomial approximation of Poisson measure which lets np tend to p when n 00 
gives from 

Ep(rt(/i/)=pEp(p)(/(l + .)). (7) 
Some algebra provides, by conditioning, a mixed binomial-Poisson version 

E8(„,p)*-p(p)(ft/) = np'Ei3(n-l.,p)*V{p)ifi^ + ■)) + pEg(„ p)^73(p)(/(l -I- •)) . (8) 

In particular, the Mehler like formula JSJ gives for any n E N* and t E M+, 

pPtihf) (n) = /i"P(t)R(/(l + •)) (" - 1) + AgWPt(/(l + •)) H, (9) 

where ft : N ^ N is defined by h{n) := n for any n e N. The binomial-Poisson nature of the 
M/M/cx3 queue is related to the fact that the coefficients of its infinitesimal generator are 
affine functions of n. The reader may find an analysis of linear growth birth and death processes 
in |2ni and and references therein. 
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1.4 Convex functionals 

For any convex domain V of M" , let us denote by C-p the convex set of smooth convex functions 
from T) to K. Let I C K be an open interval of E and $ G Cj. We denote by V-'^[Q) the convex 
subset of functions / G L^((9) taking their values in X and such that <&(/) € L-'^((5). We define 
the $-entropy Entg(/) of / e Li^*(Q) by 

Ent*(/) :=Eq($(/))-$(Eq/). 

Is is also known as "Jensen divergence" since Jensen inequality gives EntQ(/) ^ 0. Moreover, 
when $ is strictly convex, EntQ(/) = if and only if $(/) is Q-a.s. constant. One can distinguish 
for function $ the following three usual special cases. 

(PI) <i>(u) = u\og{u) onX = R;, andEnt*(/) = EntQ(/) Eq(/ log(//EQ/)); 
(P2) $H ^u^onl^R, and Ent*(/) - VarQ(/) Eq((/ - Eq/)^); 
(P3) ^{u) = It" on X = with a e (1, 2). 

The Entg functional is linear in $ and vanishes when $ is affine. Let us define from the interval 
X C M the convex subsets Tr C 7J C by 

u + w) G I X 1} and 7j {(w, u) G M^; w G I, (?7 +1) n T 7^ 0}. 

The A-B-C transforms of $ arc the functions A*, : Ti ^ M and C* : Tj ^ M defined by 

:= $(u + w) - - $'(«)?;; 

These three transforms are linear in (f>, and their kernel contains any affine function. Various 
additional properties of these three transforms are collected in Section 0] In particular, the 
convexity of $ on X is equivalent to the non negativity of its A — S — C transforms on 7i. In 
particular, the following statements hold. 

• A*, _B*, C*, Entg arc non negative and convex for (P1-P2-P3); 

• 2yl* = = C* for (P2), A* ^ C* for (PI), and A* ^ for (P1-P2-P3). 

On the two point space {0,1}, the <I>-entropy gives rise naturally to the A-transform of Namely, 
for any / : {0, 1} ^ X with (a, b) :^ (/(O), /(I)) and (w, v) := (a, b - a), 

Ent* = g$(a) - $(qa =M*(u,«) - (10) 

The A — B — C transforms are the germs of discrete Dirichlet forms via the identities 

A*(/,D/) =D$(/)-<i>'(/)D/; 
i3*(/,D/) =D($'(/))D/; 
C*(/,D/)=$"(/)|D/|^ 

The reader may find explicit examples in tabled We used above the following identity, valid for 
any functions lyS : R — > R and / : Z ^ R, 

D(^(/)) = ^(/(l + •)) - Vif) = ^(/ + D/) - ^(/), 
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where /(! + •) stands for Z 9 n i-^ f{l + n). In particular, /(! + •) = / + D/. The usage of the A — 
B — C transforms aUows, as presented in the sequel, to derive several entropic inequalities in the 
same time, including Poincare inequalities and various modified logarithmic Sobolev inequalities. 
They reduce most of the proofs to convexity, and they provide various comparisons for discrete 
Dirichlet forms. 

For any open interval I C M and any probability space {E,£,Q)^ we denote in the sequel 
by K,{E,X) the convex set of measurable functions E 2 with a relatively compact image 
in T. These functions are bounded. Notice that IC{E,T) is a convex subset of L^'*((3). The 
introduction of IC[E,X) permits to avoid integrability obstructions at the boundary of X when 
dealing with the derivatives of <&. Any element of L^^*((3) is a pointwise limit of elements of 

/C(£:,x). 



Function 4> 



(PI) ulog('u) 

(P2) 7/2 

(P3) 



(PI) ulogiu) 

(P2) 1*2 

(P3) 



(PI) Mlog(u) 



(P2) 
(P3) 



(u + v){\og{u + w) — log(u)) — V 
{u + v)" - - au^^^v 

v(log{u + v) - log(u)) 
av{{u + v)"-^ u""-^) 



2v^ 



^*(/,D/) 

(/ + D/)D(log/)-D/ 
|D/|' 

D(r)-ar-iD/ 

B*(/,D/) 

D(/)D(log/) 
2|D/|^ 

«D(/)D(r-i) 

C*(/,D/) 

2|D/|2 



Table 1: Examples of A- B -C transforms. For (P3), a G (1, 2 



2 From two point space to binomial-Poisson inequalities 

Let p G [0, 1] and let B{l,p) be the Bernoulli measure qSo + p6i on {0, 1}, where q := 1 — p. We 
identify the two point space {0, 1} with the "circle" Z/2Z, for which 1 + 1 = 0. In particular, 
the the "+" sign in the definition of D is taken modulo 2. Then, for any / : {0, 1} T, the 
following identity holds. 

ME6(i^p)(i?*(/, D/)) - Ent|(i,p)(/) = A*(ap(a, b - a)) + a - bj), 

where (a, 6) := (/(0),/(l)) and where is as in (|38|l . Now, Lemma f4 . 1 1 gives that ^* is non- 
negative as soon as $ is convex. Consequently, when <I> is convex, we obtain the following entropic 
inequality for B{l,p). 

Ent* i,p)(/)<pqEf5(i,p)(i?*(/,D/)) . (11) 
Unfortunately, the inequality 1)11(1 is not optimal for (P2) since in that case, 

Entg(i^p)(/) = VarB(i,p)(/) =m(,/(1)-./(0))' whereas Egfi^p) (i3*(/, D/)) = 2(/(l)-/(0))2. 
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This is due to the fact that -B*(/, D/) = 2|D/|^ for (P2). We derive in the sequel the A transform 
version, which is stronger and optimal for (P2) since D/) = |D/|^ in that case. All the 

inequalities obtained in this section involve the A transform in their right hand side. They hold 
for example in the cases (PI), (P2), (P3). The A transform can be bounded by the B or the 
C transforms, by using the elementary bounds given by Lemma 14.21 We start with an entropic 
inequality for the Bernoulli law B{l,p). By convolution, we derive from this two point space 
inequality a new entropic inequality for the binomial law B{n,p) = B{l,p)*". An inequality for 
the Poisson law V{p) is then obtained by binomial approximation. The binomial-Poisson case 
is derived by tensorisation. The following calculus Lemma is a $ version of [51 Lemma 2] by 
Bobkov and Ledoux. 

Lemma 2.1 (two point Lemma). Let <i> e Cj such that $" € Cj. Let U : [0,1] M. be defined 
by 

U{p) := Ent^(i -toEb(i,p)((?) , 
where /, g : {0, 1} X. Then, U ^ on [0, 1] if and only if 

J7'(0) s; J7'(l). (12) 

Proof We denote (a, 6) := (/(0),/(l)) and (a,/?) (g(0), .g(l)). We get then 

U{p) = q<l>{a) + p$(&) - $(ga + pb) - pq{qa + p/3). (13) 

The last term is a polynomial in p of degree three. Taking the fourth derivative in p gives 

U""ip) = -{h- af<^>""{qa + pb). 

Since $" is convex, we have U"" ^ on (0, 1) and thus U" is concave. Consequently, there 
exists < po ^ Pi ^ 1 such that U" ^ on [0,po] U [pi, 1] and U" > on [po,Pi]- We have 
that U is concave on [0,po]- But C/(0) = and by assumption U'{Q) ^ 0, thus ?7 < on [0,po] 
by concavity. A consequence is that U{po) ^ 0. Similarly by symmetry we have that [/ ^ on 
[pi, 1] and U{pi) ^ 0. Now since U is convex on [poiPi] and non-positive on the boundaries, it 
is non-positive on the whole interval [pQ,pi]. Therefore H12|) implies f/ ^ on [0, 1]. □ 

One can show by similar arguments that if additionally /(O) ^ /(I) and 17(0) ^ g{l) (respec- 
tively /(O) < /(I) and g(0) ^ .g(l)), then the condition (fl^ may be weakened into U'{0) ^ 
(respectively U'{1) > 0). Notice that in terms of A transform, 

U'{0) = A'^{a,b-a) - a and t/'(l) = A*(a, 6 - a) + (14) 

The following Lemma provides the A transform version of (|ll|l . 

Lemma 2.2 (two point entropic inequalities). Let $ g Cj such that $" e Cj. Then, for 
any f : {0, 1} I, 

Ent|(i,p)(/) <pgEe(i^p)(A*(/,D/)), (15) 

where the "+" m (jSJ 0/ D is taken modulo 2. Moreover, the inequality becomes an equality for 
(P2). 

Proof. Let U be as in (P|l with g = A^{f,Y}f). From lO we get 

C/'(0) = A*(a,6-a)-A*(a,6-a) = and C/'(l) = A*(a, 6 - a) -f A*(6, a - 6), 

where (a, 6) := (/(0),/(l)). By Lemma l4.ll function A* is non negative and thus U'(X) ^ 
0. Therefore (|15|l follows by virtue of Lemma l2.ll Notice that since +1 = —1 in Z/2Z, we 
have D = D*. In particular, for any / : {0,1} — > T, the function B'^{f,Df) is constant, and 
A*(/,D/) = A*(/,DV). □ 
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Notice that (|15|l can be rewritten as 1)40(1 . Entropic inequalities like (|15|l belong to the so 
called family of $-Sobolev inequalities, which are known to be stable by convolution, cf. [ Ill 
Corollary 3.1 page 342]. This observation leads to Theorem l2 . 31 below, by using the tensorisation 
property 1(34(1 of Theorem 14. 41 

Theorem 2.3 (Bernoulli entropic inequalities). Let M := B{l,pi) * ■■■ * B(l,p„) and 
Cm ■= niax{pigi, . . . ,p„(7„} where pi, . . . ,pn E [0, 1]. Let $ G Cj such that A* G Ctx- Then, for 
anyf-.n^I, 

Ent*,(/) CA/EM((n-MA*(/,D/) + /iA*(/,D*/)), (16) 
where ft, : N ^ M is defined by h{k) = k for any A; g N. In particular, 

Enti(„,p)(/) «;pqEe(„,,)((n-ft)A*(/,D/) + ftA*(/,D*/)), (17) 

for any n g N*, any p G [0, 1], and any / : N — > X. Moreover, if t is as in ((32(1 . 

Ent* „,p)(/) nTOEe(„„i,p)(gA*(/,D/) +pA*(T(/,D/))) . (18) 

The optimality of these inequalities in the case (P2) can be checked for a linear function /. 

Proof. First of all, by virtue of Theorem 14.41 the convexity of A* on Tj implies the convexity 
of <&" on J. Let {Ei,Qi) = ({0, 1}, B{l,pi)) for any i G {1, . . . , n}. Let / : N ^ X and consider 
the symmetric function g : Ei x ■ ■ ■ x En — » I defined by g{xi, . . . , x„) := /(a^i + • • • + Xn). The 
tensorisation formula l(34() together with the two point entropic inequality ((15(1 of Lemma 12.21 
gives 

EntS,«...«Q„(.9) CqEq,«...^q„ l^f] A*(g,D«.g)j , 

where D^*) denotes the operator D acting on the i**^ coordinate with modulo 2 as in Lemma 
At this step, we notice by denoting s„ := xi + ■ ■ ■ + Xn that for any x G {0, 1}"", 

n 

5^A*(g,DWg)(x) = (n - s„)A*(/, D/)(s„) + s„A*(/, D*/)(s„). 

i=l 

Outside {0, . . . ,n}, the function / takes values which come with a null coefficient in the right 
hand side. The desired result follows since M is the law of s„ under Qi O • • • (8) Qn- Inequality 
((1(^(1 reduces to ((17(1 when pi = • • • = p„ = p. It remains to establish 1(18(1 . By virtue of (0) and 
(O, the right hand side of ((17(1 is equal to 

"Ee(„_i,p)(gA*(/,D/) +M*(/,D*/)(1 + •)) • 

Inequality 1(18(1 follows then from the simple identity 

{f,D*f){l + -)^T{f,Df). (19) 

When n = 1, then M ~ B{l,p), and ((16(1 reduces to ((15(1 . Beware that D in p5(l is taken modulo 
2. □ 

Corollary 2.4 (Poisson entropic inequality). Let $ G Cj be such that A* G Ctx- Let p > 

and V{p) be the Poisson measure of mean p. Then, for any p G and any f G {V{p)) , 

Ent*(^)(/)^pEp(,)(^*(/,D/)). (20) 
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Proof. Notice that the right hand side of H20() takes its values in [0, +00]. By approximation, 
we can assume that / g /C(N,X). Consider now H18() . Let p depend on n is such a way that 
Ihnn^oc npn — p. Since hm„_>ooPn = 0, we have qn 1- Moreover, B(n,pn) 'P{p) and 
Bin~l,p„) ^V{p). □ 

To the author's knowledge, inequality (pn|l appeared for the first time in for (PI), in 
p. 357] for (P2), and in JT] for the general case. See also The B and C transforms versions 
of H2U|) . which are weaker, appeared in particular in (J and 0- 

Corollary 2.5 (Binomial-Poisson entropic inequality). Let $ G Cj &e such that A* e Cr^- 
Let Mn be the probability measure Mn = B{n,p) * V{p) where p G [0,1], p G K+, and n G N. 
Then, for any f G L^'*(7'(p)), 

Ent*^(/) pEm„(^*(/,D/)) +nTOEM„_,M*(/,D/) +p^*(t(/,D/))) . (21) 

Proof. By approximation, we can assume that / G /C(N,X). If n 0, then (|21(l reduces to (|2()|l . 
Let us assume now that n > 0. Let {Ei,Qi) = (N,S(n,p)) and (£'2,(92) = (I^,^(p))- Let 
g : El X E2 ^ 1 he defined by g{xi,X2) — f{xi + X2). Let us denote by D^^^ and D^^' the 
D operator which acts on xi and X2 respectively. The inequalities H34|l . H18|) . (|20|l yield that 
Entg^^Q2(5) is bounded above by 

nMEQ,(EQ„(qA*(5,D(i)g) + M*(T(g, Df^g)) )) + pEg, (Eq, (A*(.g, D(2)g))) , 

where Qo 'S(n — l,p)- Since D commutes with translations, we get for i = 1, 2, 

(<7,D«5)(a;i,a;2) = (/,D/)(xi+a:2). 

Inequality (|21|l follows since M„, respectively M„_i, is the law of xi + X2 under Qi (g) (32, 
respectively Qq®Q2- □ 

The expectation with respect to M„_i in the right hand side of (|21|l may be rewritten as an 
expectation with respect to Af„ by using 

3 Entropies along the M/M/oo queue 

We start with the decay of the <I>-entropy functional along the queue. 

Theorem 3.1 ($-entropies dissipation). Let $ G Cj. Let (Pt)f^o be the M/M/oo semi- 
group with input rate A > and service rate p > 0. Then for any f G /C(N,X), the real function 
t G K+ Ent*^p^(P4/) is non-increasing. Moreover, when A* G Cti, 

Ent*(^) (PJ) e-^^*Ent*(^) (/) , (22) 
where c is the best (i.e. biggest) constant in the inequality 

V/ G L''^{V{p)), c/iEnt*(^)(/) «C AEp(,)(i?*(/,D/)) . 
It holds with c = 1 in general, and with c = 2 for (P2). 
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Proof. Let us denote Q = V{p). Since EntQ(Pt/) = EQ(Pt$(/)) - $(Eq(/)), the invariance of 
Q gives, 

9iEnt*(Pi/) = EQ(a>'(PJ)LPJ) . 

Jensen inequality yields Ft($(/)) ^ $(!?(/)) as soon as $ is convex. In particular L$(/) 
$'(/)L/, which gives Eq($'(/)L/) ^ as soon as $(/) is Q-integrable. Hence, 1 1-^ EntQ(Pf/) 
is non-increasing, and we used only the convexity of <i>, the Markovian nature of (Pt)t^o, and the 
invariance of Q. The Poisson integration by parts - which is this time specific to our settings 
- yields for any g 

EQ($'(g)Lg) = -AEQ(D(ff)D($'(5))) = -AEQ(i3*(g, D.g)) . (23) 

In particular, for g ~ Ef(/), we get, 

dtEntliPJ) - -AEQ(i3*(Pt/,DPJ)) . 

Notice that since $ is convex, we have ^ by virtue of Lemma ITTI In the other hand, when 
is convex, the Poisson entropic inequality H20II together with the bound A* ^ _B* of Lemma 
14.21 gives 

-AEQ(i?*(P,/,DP,/)) ^ -^Ent*(PJ) . 

Putting all together yields 9tEntQ(Pt/) < — /iEntQ(Pt/), which gives if^ . Finally, the correct 
constant for (P2) comes from the fact that 2A* = i?* in that case. □ 

For any probability measure 7 on N, and any t £ K_|-, we denote by jFt the probability 
measure on N defined for any bounded function g : N ^ M by E^Pj(g) :— E^CPtig))- In 
particular, when 7 = (5„ for some fixed n S N, we get (5„Pt = !?(•) (n). We have 7 <C 'P(p) for 
any probability measure 7 on N, as soon as p > 0. Let us define := d-f / dV (p) . Since V{p) is 
symmetric for L, we have that L and Pt{') are self-adjoint in h'^{V{p)). Therefore, one can write 
for any .9 G h'^iV{p)) 

[ Pt{f,)gdV{p) = / Pt{g)f^dV{p) = / Pt{g) dj ^ [ gdi^P^). 

Jn Jn Jn Jn 

Recall that the total variation norm ||a||rpy of a Borel measure a on an at most countable set S 
is defined by ||Q;||rpv ~ illo^lli = ^^xes l*^!-^)!- P probability measures on 5, 

the distance \\a — /3||xv 

||a-/3||Tv = sup |a(A) -/3(B)| i sup 
A<^s ^ 11/11^^1 

Recall the well known bound for any a,6 G M+, \\V{a) - 'P(6)||tv 1 - e^C'""), cf. ^ Prop. 
6.1 page 143], which gives from (j^J for any t e M+ 

l|Pt(-)(0)-P(p)|lTV^l-e-'"^"''. 

Theorem 13.11 for (PI) produces in particular a bound for ||It(-) (n) — 7'(p)||rpy, as stated in 
Corollary O 

Corollary 3.2. Let (Pt)t^o the semi-group 0/ the M/M/oo queue with input rate A > and 
service rate p > 0. For any n G N and any t G M+, 

2||R(.) (n) - V{p)\\%^ s=: e-^nog{ePp-^n}). 
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The proof follows the lines of a method due to Diaconis and SalofF-Coste, cf. for example 

iniEsi. 

Proof of Corollary \S. SI Since Q := V{p) is symmetric for L, 

where f^ := d'^/dQ. The Pinsker-Csiszar-Kullback inequality states that for any couple (a,/?) 
of probability measures on the same measured space 2||q! — /3||^y ^ Ent(a | (3) = Ent^((ia/(i/3), 
where Ent/j is the $-entropy in the case (PI). Let < e M+ and n e N. For (a, [i) — (Pt(-) (n), Q), 
we can write by ij^U and (|^ 

2||7Pt - QIItv ^ EntQ(R(/^)) ^ e-^*EntQ(^) . 

For 7 — 6n for some fixed n g N, we get jPt — !?(•) (n) and fs^ — !{„} /Q{n). As a consequence, 
we obtain as expected EntQ(/5^) = — \ogQ{n) = log(e''p""n!). □ 

3.1 Local inequalities and semi-group interpolation 

Standard Brownian motion on R starting from x interpolates on the time interval [0, t] between 
the Dirac measure and the Gaussian measure J\f(x,t). It is known that this interpolation 
provides the optimal Gaussian logarithmic Sobolev inequality. Similarly, the simple Poisson 
process of intensity A starting from n interpolates on the time interval [0, t] between the Dirac 
measure 6n and the translated Poisson measure (S„ * V{Xt). By analogy, let us give a proof of 
the Poisson entropic inequality (|2()|l by using the simple Poisson process, which corresponds to 
an M/M/cx) queue with ^ = 0. In that case, L = AD and Pt(-) (0) = 'P(At). Let $ G d such 
that v4* e Ctx, cf. Theorem 1131 One can write by abridging Ei(-)(0) in Pt{') and denoting 
F^Pt^sif), 

Ent|(,)(/)= Pi ($(/)) -cI>(Pi(/)) 

= / dsPsmPt-sf)) ds 
Jo 

= [ Ps{L<^{F)-^'{F)LF) ds. 
Jo 

Now, L<P{F) - <i>'{F)LF = A*(F,DF), and ^ with fi = gives DF = DPt_^(/) = Pt_,.(D/). 
Thus, we get, 

Ent* (,)(/) = A /*P,(A*(F,DF)) ds 
Jo 

- A / Ps{A^{Pt-sf,Pt-sBf)) ds. 
Jo 

Finally, Jensen inequality for convex function A* gives then the desired result, 

Ent*(,)(/) sc A rP,(Pt„.(^*(/,D/))) ds = AtR(^*(/,D/)) . 
Jo 
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M/M/oo semi-group interpolation on the time interval [0, +00] 



The standard Ornstein-Uhlenbeck process on M starting from x interpolates on the time interval 
[0, +00] between the Dirac measure 5x and the standard Gaussian measure A/'(0, 1). It is known 
that this interpolation provides the optimal Gaussian logarithmic Sobolev inequality. Similarly, 
the M/M/cx) queue with intensities (A, /i) starting from n interpolates on the time interval [0, +00] 
between the Dirac measure 5n and the Poisson measure V{p) where p = Xj \i. Notice that when 
A = 0, this interpolation holds between (5„ and (5o (pure death process). By analogy, let us give 
a proof of the Poisson entropic inequality H2()|l by using the M/M/oo queue. Let (Pt)t^o be the 
M/M/oo queue semi-group with input rate A and service rate p.. Let $ S Cx such that g Ctx, 
cf. Theorem 14.41 We denote by Q the Poisson measure 7^(p). For any / e /C(N,X), we write 



Ent*(/) = + / (<i>(Po/) - <i>(Poo./)) dQ 

Jn 

= -11 dMPtf)dtdQ 

Jfi Jo 



JN 



$'(Pt/)LPJdQdt 
= xf [ B'^{Ptf,BPtf)dQdt, 

JQ Jti 

where we used (|23|l for the last equality. Now, the commutation Q yields 

Ent*(/) = A r f i3*(PJ,e-^*PtD/)dgdt. 
Jo Jn 

Jensen inequality for and !?(•) followed by the invariance of Q give 

Ent*(/) ^X r f B''{f,e-^'Df)dQdt. 

jQ Jti 

But by Lemma Eini e-''*u) ^ e-''*B*(w,u) for any {u,v) G Tj, and thvis 

Ent*(/)<A r e-^^'dt [ B^ {f,Df) dQ ^ pEq{B^ {f,J^f)) , 

Jo JN 

which is exactly the B transform version of the Poisson entropic inequality H2()(l . 

Remark 3.3 {A — B — C transforms and discrete space). The interpolation on [0,t] gives 
rise to the A* transform whereas the interpolation on [0, +00] leads to the B^ transform. In con- 
tinuous space settings, the diffusion property permits to write 'L<^{F) — <^'{F)'LF = ^" {F)T{F, F) 
which is close to C* and not to A* in that case. 



Local inequality and semi-group interpolation on the time interval [0, t] 

Consider the semi-group (Pt)t^o of the M/M/oo queue with input rate A and service rate /i. The 
family (Ps(-)(n))o^s^t interpolates between Sn and B{n, e"'^*) * V{p[l — e"'^*)). Let $ G Cj such 
that ^* e Ctx, cf. Theorem |0| The inequahties ^ and @ give for any n G N, any t G K_|-, 
and any / G /C(N,2:), 

Ent* .)(„)(/) sc: pg(t)R(A*(/,D/)) {n) + np{t)qm{q{t)A'' {f ,I}f) + p{t)A'' {T{f ,I}f))) {n-l). 

(25) 
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Let us try to recover H25|l by semi-group interpolation. We write as for the pure Poisson process 
case, 

Ent* (.)(„)(/) - nm)) in) - mif) h) 



dsPsmPt-sf)){n) ds 







= / E,.(L$(F) - $'(F)LF) (n)ds. 

where F := Pt-s{f)- At this step, we notice that 

L$(F) - <^'{F)l,F = AA*(F, DF) + ^ihA'^{F, D*F), 
where /i : N ^ N is defined by h{k) = k for any fc G N. Thus, we get 

Ent* (.)(„)(/) -A rP,(^*(i^,DF))(n)ds + /i /V, D*F)) (n)ds. 

JQ Jo 



(26) 



By virtue of , (|41|l , Jensen inequahty for the convex functions A* and C* , and the semi-group 
property, the first term of the right hand side of (|26|l is bounded above by 

Q A - sfqit - s) ds^ R (C* (/, D/)) (n) + (^A j\{t - ds^ R (A* (/, D/)) (n). 

For the second term of the right hand side of (|26|l , we first write by virtue of and (|19(l , 

A*P.(/iA*(F,D*F)) (n) = A*np(s)R(A*(T(F,D^^))) (n - f) + A<z(s)R(A*(T(i^, DF))) (n). 

Now, by 101) , l|42|l , Jensen inequahty for the convex functions A* (r) and C* , and the semi-group 
property, 

P,(A*(r(F,DF))) (fc) ^ ip(t-s)2q(t-s)R(C*(/,D/)) (fc) - s)3R(A*(r(/,D/))) (fc) 
for any k E {n—l,n}. Thus, the second term of the right hand side of H2fi|l is bounded above by 

(^fm j\{s)p{t - sf d^ Vt (A* (r(/, D/))) {n-l)+ Q^n j\{s)p{t - sfq{t - s) d^ R (C* (/, D/)) (n-1) 
+ (^A j\{'^)p{t - ds^ Pt {A" (r(/, D/))) Q A j\{s)p{t - s)\{t - s) ds^ R D/)) (n). 



Putting aU together, we obtain finaUy the foUowing local inequality. 



A*(r(/,D/)) + ic7*(/,D/) 



+ inp(t)R (^(1 - p(t)2)yl*(r(/, D/)) ^gW^C^C/, D/) j {n - 1), 

(27) 

which is not l|25|l . Actually, H27|) is in a way stronger than H25|) for small t, as we will see in the 
sequel with the fluid limit approximation of the Ornstein-Uhlenbeck process. When i — > oo, we 
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have p{t) 0, q{t) 1, and A* + A*(r) = B*, and in that case, H27|l provides the following 
Poissonian inequality. 

Ent*(^)(/) «C ipEp(,) Qi?*(/,D/) + ic*(/,D/)) (n), 

which is not (pn|l . The proof of (|?7jl given above suggests to use (PHll instead of its consequences 
(|41|l and H42(l for the derivation of local inequalites via semi-group interpolation. The inves- 
tigation of this approach is left to the reader. Notice that (|4()|l is not strong enough. Let us 
focus on the (P2) case, for which we have the simple identity 2A*(/, D/) = 2A*(r(/, D/)) = 
B*(/,D/) = C*(/,D/) = 2|D/|^ In that case, |23 is the optimal local Poincare inequality, 
e.g. 

Varp^(.)(„)(/) sc: pg(t)R(|D/|') (n) + (|D/|') (n- 1). 

3.2 Scaling limit of the entropic inequalities 

Let us consider the Poisson distribution 'P{p) with parameter p > 0. For any iV e N*, let 
kn : N ^ M be the function defined by Kj\i{n) := N^^^^{n — pN) for any n £ N. By virtue 
of the Central Limit Theorem, the image measure of V{Np) = V{p)*^ by k^t converges weakly 
towards the Gaussian measure A/'(0, p) when iV — > oo. Let g € /C(IR.,X) be smooth with bounded 
derivatives, and set fjsi '.— go kn. In one hand, we have 

^liij;^Ent*(^p)(/Ar) = Ent* . 

In the other hand, by a Taylor formula, D{ff^) = T){g o kn) ~ N~^^^{g' o kn) + 0{N), and by 
a Taylor formula for $ this time, A*(/Ar, D/w) = {2N)-\g' o K7v)^«'"(/7v) + o{N). This yields 
that 

lim piVEp(p)(A*(/^,D/^)) = ipE^(o,p)(C*(g,5')) ■ 

A* — >OQ Z 

Now, the A-transform based Poisson entropic inequality (|20|1 for V{N p) and /at gives finally that 

Ent^(o,p)(5) < ipE^(o,i)(C*(5,5')) • (28) 
Recall that the Poincare inequality corresponds to (P2). In that case, 

Ent^(o,p)(5) = VarA/-(o,p)(5) and C'^{g,g') = 2\g'\^ . 
The logarithmic Sobolev inequality corresponds to (PI). In that case, 

EntV,)(g)=EnW(o,p)(g) and C*(5,<?') = ^- 

The constant p in H28|l is known to be optimal. It gives in particular the optimal Poincare 
inequality for the Gaussian measure in the case (P2), and the optimal logarithmic Sobolev 
inequality for the Gaussian measure in the case (PI). The method was used in the case (PI) 
in 35 , Remark 1.6]. In some sense, the A transform is the right Dirichlet form to consider since 
it allows the derivation of optimal Gaussian entropic inequalities from their A-transform based 
Poisson versions. In contrast, it is shown in 6, pages 356-357] that the optimal B transform 
version for the Poisson measure does not lead to the optimal constant in the logarithmic Sobolev 
inequality for the Gaussian measure (lack of a multiplicative factor 2). The deep reason for this 
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difference between A and B transforms consequences is the fact that the comparison ^* ^ 
improves by a factor 2 when v goes to 0, as stated in Remark 14.31 This phenomenon does not 
hold for the Poincare inequahty, since 2yl* = for (P2). 

As presented in Section !]"^ the M/M/oo queueing process gives rise to an Ornstcin-Uhlenbeck 
process via a fluid hmit procedure. It is quite natural to ask about the behaviour of the binomial- 
Poisson entropic inequalities under this scaling limit. 

Let {X^)t^Q be an M/M/oo queueing process with input rate NX > and service rate 
/i > 0, where N G N*. Let {Ut)t^Q be an Ornstein-Uhlenbcck process, solution of the Stochastic 
Differential Equation dUt = XdBt — fiUt dt. Let g E /C(R,X) be smooth with bounded derivatives. 
For any y S R, we define zjv '■— iNp + iV^^^yJ where [-J denotes the integer part. According to 
Section ll.2l the image measure of C{X^ \ Xq = zn) by function converges weakly towards 
C{Ut\UQ = y) when N goes to og. Notice that 

C{X^ I = zn) = B{zN,p{t)) * ViNpqit)) 

and that C{Ut\U() = y) = N{yp{t),p{l — p{t)'^)). In particular, if fjy g o kn, then 

Jim^Ent*(^„ I x«=.„)(/a') ^ ^^^C{u, \ u,=y){9) ■ 

In the other hand, as for the pure Poisson measure case, we have 

^l™^^^E^(xf |x«=.„)(^*(/A',D/iv)) = l^c(u.\u„=y){C^(.9,9')) ■ 
A similarly identity holds for j4*(r(/jv, D/jv)). Putting all together, we deduce from (|25|l that 

(Ut I Uo=v) {C''{g,g')), (29) 

where K{t) := ^pq{t){l + 2p{t)). It is known that the best constant in ^ is K*{t) := ^pq{t){l + 
p{t)). Let us consider now the function 9 : M+ defined for any t E (0,oo) by 



This function is non-increasing, with 9{0) — | and limj^+oo ^(^) = 1- Consequently, the constant 
K{t) in the inequality H29|l improves when t increases. It is asymptotically optimal, when t goes 
to +00. Surprisingly, it turns out that the usage of (|77jl instead of lP5|l provides (|^ with 
constant K*{t) instead of constant K{t). As a consequence, (|?7| is in a way stronger than (jJSJ, 
at least in terms of their fiuid limit. 

Remark 3.4 (The M/M/1 case). The M/M/1 queue with input rate A and service rate p is 
the birth and death process on N with generator L = pD* + AD. We have [L,D] = and the 
"curvature" is identically zero. When A > and p > 0, the symmetric invariant measure Q is 
given by Qin) = p" for any n G N, with p := \/p. The associated Markov semi-group {Pt)t^o 
satisfies to the exact commutation formula DPf — Ft(D). Measure Q is finite if and only if p ^ 1, 
and Q is in that case the geometric measure G{1 — p) of mean A/ (p—X). This leads to Poisson like 
entropic inequalities for Ef(-). The M/M/1 is a discrete space analog of the continuous process 
{Et)t^o solution of the Stochastic Differential Equation dEt = dBt — sigiii{Et)dt. 

Remark 3.5 (Spectrum). A function f : N —^ R is an eigenvector associated to the eigenvalue 
a G R for the M/M/oo infinitesimal generator L defined by ^ if and only if Xf{n + 1) = 
(A + a + np)f{n) — npf{n — 1) for any n G N. Obviously, for any a G R and any starting value 
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/(O) 7^ 0, the equation above has a unique non null solution. As a consequence, the spectrum of 
L is M. We will denote by fa the unique solution such that /q(0) = 1. By the equation hfa — Cif 
and the invarianee of Q :— Vip) we get that 'Eiq^fa) — Q as soon as fa G \j^{Q). Suppose that 
fa e L2(Q), then < EQ(r(/,/)) = -Eq(/L/) = -aEQ(/2) and thus a ^ 0. Moreover, 
TheoremWl\for (P2) gives ini {-a G M, G l^'^iQ)] = c/. Prop. 2.3]. 

Remark 3.6 (Bakry I2 calculus). Let us define the Markovian functional quadratic forms T 
and T2 by 2r(/, /) := L(/2) - 2/L/ and 2T2{f, f) := Lr(/, /) - 2T{f, Lf). After some algebra 
based on we get 

2r(/, /)(n) = np\B*f\'{n) + A|D/|2(n) 
for any / : N — > K and any n G N, and 

2T2{f, f){n) = ^AM|D/|2(n) + '^^,^\D* f\\n) + R(/, f ){n), 

where 2R(/,/)(n) := n{n-l)p^\V)*V>* f\^ + 2n\n\T>V>* f\^ + \^\V>V>f\^ . Notice that for the linear 
function f{n) — n, we get 

2T{f,f){n)^\ + npi and AF^if, f)in) ^ 3Xfi + 

Since R(/, f)^0 for any f , we obtain immediately the bound I2 ^ M^T, which is the infinitesi- 
mal version of the commutation TPt =^ s^p{—t^)PtT . Moreover, an integration by parts similar 
to O gives the integrated bound Eq(I2/) ^ pEQ{Tf), where Q := V{p). Such a bound gives, 
via integration by parts, the Poincare inequality VarQ(/) ^ /9Eq(|D/|'^), which is exactly (|20() 
for (P2). However, the I2 bound above suggests that I2 is not the right tool in order to derive 
^-entropic inequalities beyond the (P2) case. Bakry-Emery type approaches are designed for dif- 
fusion. In discrete space settings, the lack of chain rule reduces their strength for the derivation 
of entropic inequalities beyond the (P2) case. 



4 Convexity and ^-calculus on A — B — C transforms 

We give in the sequel various convexity properties, which extend in particular many aspects of 
Let <1> : X ^ R be a smooth function defined on an open interval X C M. The usage of 
suitable Taylor formulas provide for any {u,v) G Tx, 

A*(u,w)= ( {l-p)C'^{u + pv,v)dp and S*(u,w)= [ {u + pv,v) dp, (30) 
Jo Jo 

and for any (u, w) G 7J and small enough e, 

A*(ii,£v) = ic*(u,w)£2 + o(£2) and B*(u,£v) = C*(w,v)£2 + o(£2). (31) 

We denote by t : Tj ^ Tj the bijective linear map defined for any {u, w) G 7x by 

t(u, v) := (u + V, —v). (32) 

Notice that t is well defined since (u, v) Tj implies that {u -\- v,u -\- v — v) gXxX and thus 
{u + V, —v) G Tx- Writing (a, 6) := (m, u -\- v) shows that the map t transposes a and 6, and 
is the identity map. Moreover, 

A'^iu, v) = $(6) - $(a) - $'(a)(6 - a), 

B^{u,v) = {b-a){^'{b)-<i>\a)), 

C*(u,w) = $"(a)(6-a)2. 
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Lemma 4.1. Let $ : X — s- R 6e smooth on an open intervalX C M. Then the following statements 
hold. 

1. A* + y4*(r) = and B*(t) = B*; 

2. Each of , , C* is non-negative if and only if ^ E Cx- 

Proof. The first statement of the Lemma is immediate. For the second statement, we observe 
first that C* is non-negative if and only if <i>" is non-negative, e.g if and only if $ e Cj. The 
same holds then for A* and by using H31|) and (j^OJl. □ 

Lemma Wa\ tells that the A — B — C transforms map the set of convex functions on T into the 
set of non-negative functions on Tj. Moreover, their null space contains any real valued affine 
functions on X. 

Lemma 4.2. Let <f> : Z — > R fee smooth on an open interval X d R. The following statements 
hold. 

1. for (P1-P2-P3), we have > on X and -1/$" belong to d; 

2. 2yl* = = C* for (P2) and A* C* for (PI); 

3. if^E Cx then A* ^ S*. 

I if ^" e Cx then C*(u -I- u/3,u) < 2^*(u,w) and C'^{u + v/2,v) < B'^{u,v) for any 
{u,v) e Tx. 

Proof. Statement n and the first part of statement [5] are immediate. Notice that 1/$" is affine 
for (PI) and (P2). The second part of statement 13 follows from the first part of H30(l . For 
statement we notice that by Lemma f4. II = A* -I- A*(r), where ^*(t) ^ when $ e Cx. 
Statement 0] follows by using 1)30(1 , the definition of C* , and Jensen inequality with respect to 
the integral over [0, 1] for the convex function p E [0, 1] i-^ + pv). □ 

Remark 4.3 (Optimality of A-B-C comparisons). The bound A* ^ _B* is optimal in 
the sense that for (PI), we have B^{u,v) ^ A'^{u,v) at v — +00 for any u E X. However, 
= 2 A* = C* for (P2); and in general 

limt;-22A*(u,w) = lim ^-^^^(u, w) =v-^C'^{u,v) = 

Theorem 14.41 below states that the convexity of the A — B — C transforms of $ are deeply 
related to the convexity of the <i>-entropy functional. It provides in particular a synthesis of some 
results by Latala and Oleszkiewicz in ,27^ , by the author in and by Massart in his Saint- 
Flour course |^ (see also the article ^). We say that a collection V of probability spaces is a 
covering collection if {Q{T);T E £, {E,£,Q) E V} = [0, 1]. An example is given for instance by 
the family of Bernoulli probability measures on the two point space {0, 1}, or by any collection 
containing a probability measure on R with a continuous cumulative distribution function. 

Theorem 4.4. For any smooth $ : X — )■ R on an open interval X C R, the following statements 
are equivalent. 

1. A* eCr^; 

2. E Ct^; 

3. C* E Cn; 
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4- either $ is affine on X, or $" > on I with —1/$" e Cx; 

5. {a,b) eJ xJ ^ f$(a) + (1 - t)<^{b) - $(ta + (1 - t)b) belongs to Cxxi, for any t £ [0, 1]; 

6. for any probability space {E,E, Q), Entg G Cx.{e,i)', 

7. there exists a covering collection V such that Entg G C]c{e.i) for any {E,£,Q) in V; 

8. for any probability space {E,£, Q) and any f £ K,{E,X), 

Ent*(/)- sup {EQ((<i>'(5)~<i>'(EQg))(/-.9))+Ent*(5)}; (33) 

9. there exists a covering collection V such that 133|l holds for any {E,£,Q) G V and any 
felCiE,!); 

10. for any product probability space {E, £,Q) := {Ei x • • • x £i® ■ ■ ■ ® £n,Qi® ■ ■ ■ ® Qn), 
and for any f G K,{E,X), 

Ent*(/) ^ EQ(Ent*^(/)) + • • • + Eq (Ent* J/)) , (34) 

where the expectation with respect to Qi in Entg. (/) concerns only the i*^ coordinate; 

11. there exists a covering collection V such that 134(1 holds for n = 2, any Qi G {B{l,p);p G 
[0, 1]}, any Q2 € V, and any f G K-iEi x E2.I). 

Moreover, if these statements hold, then $ and belong to Cj. 

Remark 4.5 (Functional spaces). By approximation, the convex set IC{E,X) can be replaced 
by the convex set L^'*((5) in statements\^ [3 1-?^ \11\ of Theorem \4.4\ More precisely, 
statement^ implies the convexity of $, which implies in turn that $'(17) (/ — 5) + $(5) ^ ^if) 
for any /, g G L^'*((5). This yields that 'Eq{{^' (g) — Eq(7)(/ — g)) is well defined in [—00, +00), 
as noticed in the proof of Lem. 2.26]. 

Remark 4.6 (Meaning of the variational formula). Despite its functional expression, the 
variational formula (|33|l is actually a unidimensional statement, taken in all directions. Namely, 
for any probability space {E,£,Q) and any f,g £ L^'^{Q), let us denote by af,g : [0, 1] ^ M the 
function defined for any A G [0, 1] by 

a/^3(A):=Ent*(A/ + (l-A).9). (35) 

Notice that Q;/,g(0) = EntQ(g) and Q!/_g(l) — EntQ(/). The consideration of convex combi- 
nations reveals that the convexity of the ^-entropy functional on L^'*((5) is equivalent to the 
convexity of af^g on [0,1] for any f and g. Assume now that a/^g is convex on [0,1] for any 
f and g in L^'*(Q)- Assume for the moment that f,g G JC{E,X). In that case, there are no 
boundary effects, and a f^g is smooth. Recall that a real convex function is the envelope of its 
tangents, cf. I.Vif . In particular, af,g{l) ^ Q;/,g(0) + ^(0). Moreover, equality is achieved for 
f ~ g. As a consequence, we get 

Ent*(/)= sup {a'fjO) + afjO)}. (36) 

It turns out that ^ (0) = EQ((<i>'(g) - $'(EQg))(/ - c/)). We thus recover exactly By 
virtue of Remark \4.o[ the formula above for a'j: ^{0) still makes sense in [—00,00) when f,g are 
in L^'^{Q), and consequently, the variational formula 1(36(1 remains true when f,g G L^'^{Q). 
Notice that a/ g(A) — 'EntQ{g + A(/ — g)), and hence a'^ ^(0) is the directional derivative of the 
^-entropy functional at point g in the direction f — g. 
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Proof of Theorem \4-4\ Follows from the identity = A* + j4*(t) where r is linear, given 

by Lemma |4. II 

l^^ni and Follow from H3()|l used on a convex combination. 

d4Qand[34{3 Follow from 1)3 l|l used on a convex combination. 
Ql^^ The Hessian matrix of A* writes for any {u,v) S Tj, 

Since ^* is convex, the diagonal elements of V^A* are non-negative, and thus $" ^ on 
T. Moreover, the convexity of A* yields that det(V^A*) is non-negative. Suppose now that 
(u, u) G 7i is such that 1;) = 0. Then det{V^ A^i^u, v)) = and thus = 0. 

Consequently, the set {w € X;^"{w) = 0} is either empty of equal to I, as required. When 
<i>" > on X, we get det(V^A*(M, u)) = ^"{u + v)^"'^{u)A~'^/'^" {u,v), which is non-negative 
since A* e Ctx- But $" > 0, and thus A"!/*" ^ 0. Lemma lO gives then -1/$" e Cj. 

^J^ni If ^ is afhne on X, then A* is identically zero, and thus belongs to Ctx- Let us 
consider the second case. Assume that $" > on X with — !/<!>" G Cx- It turns out that 
(_!/$")" ^ ($""$" _ 2$"'2)/$"3. Hence, ^ 2$"'2 on I, and thus > on I. 

In other words, $" g Cj. By Lemma 14.11 it follows that A* is non-negative. Therefore, 
the diagonal elements of V^A* are non-negative on Cj. In the other hand, for any {u, v) G Tj, 
det(V^A*(w, w)) — ^"{u+v)^"^{u)A~^^'^ (it, w), which is non-negative again by virtue of Lemma 
14.11 Putting all together, the two dimensional matrix V^A*(m, w) has a non-negative trace and 
determinant for any (w, v) € Cj, as expected. 

^3and[3=^{^ Follow from the definitions. See for instance |27| . 
I and and C^^El are immediate. 
CJ^S Let / and g be in JC{E,T). Since A* e Cr^, the following sort of "A*-entropy" 

J(/, 5) Eq(A*(5, f-g))- A* (Egg, Eq(/ - g)) (37) 

is non negative by Jensen inequality. Moreover, it vanishes when f — g. The desired result 
follows from the identity Ent*(/) = J(/,g) + Eg (($'(5) - $'(EQg))(/ ~ g)) + Ent*(g). 

For any {E,£, Q) £ V and € K.{E,I), the identity (PSl impHes that the quantity 
J(/, (?) defined by H37|l is non-negative. By approximation, J(/, g) is non-negative for any f,g£ 
L^'*(Q). Now, let [u,v) and {u',v') be in Tj, and let A € [0, 1]. Since P is a covering collection, 
there exists {E, £,Q) & V and T e £ such that Q{T) = A. Let g := wIt + wTt<: and f '.^ g + 
vIt + w'It'! . The desired result follows from the identity J(/, g) = AA* (u, w) + (1 — A)yl* (m', t;') — 

A*(A(m,v)-)-(1-A)(m',i;'))- 

and 0413 Let /, g G K{E,J), and let a/,g be as in (jSHl- It turns out that 

a"{t) = EQ(C*(;it, / - .g)) - C^{^Qht,^Q{f - g)). 

Notice that {ht, f — g) takes its values in 7J. Since C* G Cr^, we get Q!"(t) ^ 0. In other words, 
a G C[o,i]. In particular a(A) < Aa(l) + (I - A)a(O) for A G [0, 1] writes EntQ(A/ + (I - A)^) 
AEntQ(/) + (1 — A)EntQ(g), which is nothing else but the expression of the convexity of Entg. 
Additionally, since every convex function on an interval is the envelope of its tangents, see 
[321, one gets EntQ(/) = q;(1) = sup^gjo {Q;(i) -I- Q;'(t)(l - i)}. In particular, EntQ(/) ^ 
a(0) -|- Q;'(0), with equality when f — g. Taking the supremum with respect to g leads to (|33|l . 

[^40 and Let f,g £ K(E,1), and let af,g be as in JSHll- Then, for any s,t G [0,1] 
and any A G [0, 1], a(As -I- (1 - \)t) = Ent^(A(i/ + (1 - t)g) + (1 - A)(s/ + (1 - s)g)). Since 
Entg G C]c(E.x)i we get a{Xs + (1 — A)t) ^ Xa{s) + (1 — X)a{t), and thus a G C[o,i]- Since every 
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convex function on an interval is the envelope of its tangents, see we obtain EntQ(/) = 
a(l) = s■ap^^^Q ^{a(t) + a'{t){l — t)}. In particular, EntQ(/) > Q!(0) + q;'(0), with equahty 
when f — g. Taking the supremum with respect to g leads to (|33() . 

0=^ and \MB Use A/i + (1 - A)/2 - .g = A(/i - g) + (1 - A)(/2 - g) and Ent* (g) = 
AEntQ(g) + (1 — A)EntQ((7) in the expression inside the supremum in H33|l . then use the fact 
that the supremum of the sum is less than or equal to the sum of the suprema. 

IJil =^ The proof can be found in [281 introduction of section 2.5]. Namely, let (71,(72 G 
/C(i?2,I), and consider / : {0,1} x E2 ^ ^ defined by f{x,y) := gi{y) if a; = and f{x,y) :— 
512(2/) if a; = 1. The tensorisation formula expressed for / rewrites Entg^ ((1 — p)gi + pg2) ^ 
(1 - j3)EntQ^(5i) +75EntQjg2), as expected. 

13=^23 The proof can be found in the Saint-Flour course |^ Theorem 2.27]. Roughly 
speaking, it consists in the usage of the variational formula H33|l on each entropy in the right 
hand side of (|34(l . which gives rise, via a telescopic sum, to the variational formula for the left 
hand side of 

Finally, if the statements hold, then $ e Cj by statement 01 and the proof of given 
above provides in particular that <i>" G Cj. □ 

Example 4.7. For (P1-P2-P3), both $, and are convex on 1. Moreover, <i>" > 

onX and —1/$" is convex onT. Actually, —1/$" is affine for (PI) and (P2). Consider the 
case where <^{u) — ulog(— u) on I — (— oo,0). Then ^" > on I , and —1/$" > on I. 
However, — $' is concave and not convex on 2. Consider now the case where — — log(u) on 
X = (0, +cxd). Then $, ^" are convex onT, and > Q onT. However, —1/$" is concave 

and not convex. These examples rely on the stability by symmetry of the convexity of —1/^" , 
and the absence of such a stability for — 

Example 4.8. Following 111!/ , the convexities of the A-B-C transforms of^ and of the ^-entropy 
functional are stable by any linear combination on $ with non-negative coefficients. Theorem \4.4\ 
shows in particular that this stability still holds for the convexity of —1/$", for which it is less 
apparent. The consideration of continuous linear combinations on $ by mean of an integral 
with respect to a positive Borel measure provides several interesting examples. For instance, 
$(it) :— J^u^dp = u{u — l)/log(u) on I ~ is obtained from (P3), and satisfies to the 
required convexities of Theorem \4.4\ 

Example 4.9. A curious example is given by — — I(it) on X — (0,1), where I is the 

Gaussian isoperimetric function defined by 1 :— F' o F^^ where F is the cumulative distribution 
function of Af(0, 1). Function I is positive and concave on X, and satisfies to the identity II" — 
— 1. Consequently, $ and —1/$" = $ are convex. In particular. Theorem \4.4\ shows that the 
1-entropy is concave, and provides a reversed tensorisation formula. 

For any p £ [0, 1], let CTp : 7i — > 7i be the linear map defined for any (u, w) G 7x by 

ap{u,v) {u,pv). (38) 

The map ap is well defined since for any {u,v) e Xj and any p g [0,1], we have u + pv d 
[u,u + v] C X by convexity of X, and thus {u, u + pv) G Tj. Notice that C*((Tp) = p^C^ . 

Lemma 4.10. Let $ e Ci and p G [0, 1]. Let ap be as in and (|38|l . The following inequalities 
hold on Xx, 

A^{ap)^pA'^ and B*(ap) s$ pB*, (39) 
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where q:=l-p. Moreover, A*((Tp) = p^A* and B'^{ap) = p^B"^ for (P2). Let t be as in 
Assume in addition that $" G Cj, then the following inequalities hold on 7j, 



pq{pA^{T)+qA'^); (40) 

Ip'qC+p^A''; (41) 

A^iriap))) ^ ip2^C*+p3A*(r); (42) 

B'^iap) < p'qC'+p'B. (43) 



Proof The A* part of (jSH) is a rewriting of For the i?* part of (jSHI), we notice that 

$' is non-decreasing since $ is convex, and thus pv^'{u + pv) ^ pv^'{u + v) regardless of the 
sign of V, which gives the desired result. The inequality (|40|l is a rewriting of p5|) . Namely, 
pA^iu,v) - A'^iapiu,v)) = Ent|(i^p)(/) for any (u^v) G Ti, where (/(0),/(l)) := {u,u + v), 
whereas Egji^p) (A*(/, D/)) = pA*(t(u,w)) +gA*(M,u). The inequalities (glj, 63), and 113 
follow from (|3()|l by using the definition of C* and a suitable Jensen inequality for <&". □ 

Remark 4.11. The bounds (|41|l and (I42|l become equalities for (P2). However, H43(l is not 
sharp for (P2). The bound B^{ap) ^ pi?* is optimal in the sense that for (PI), we have 
B'^{u,pv) ~ pB'^{u,v) at V = +oo for any {p,u) G (0,1) x I. However, B'^{ap) = p^B"^ for 
(P2); and in general 

lim v^^B^{u,pv) = p^ lim B'^ {u, v) = p^$"(u). 

The same remark holds for A* (up to a factor 2 in the case (P2)). 

Some of the results of this section correct mistakes discovered by the author in TT' after 
publication. In contrary to what appears in ^2 Page 330], H(2') does not imply H(2). Actually, 
H(l) and H(2) are equivalent and W(2') should be removed from JTj. In particular, [TTl 
Remarks 8 and 11 pages 354-356] should be replaced by Lemma H4.1|l . These corrections are 
minor and simplifying and do not impact the results of jll| at all. 
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